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Abstract 

Monotone systems constitute one of the most important classes of dy- 
namical systems used in mathematical biology modeling. The objective 
of this paper is to extend the notion of monotonicity to systems with 
inputs and outputs, a necessary first step in trying to understand inter- 
connections, especially including feedback loops, built up out of monotone 
components. Basic definitions and theorems are provided, as well as an 
application to the study of a model of one of the cell's most important 
subsystems. 



1 Introduction 

One of the most important classes of dynamical systems in theoretical biology 
is that of monotone systems. Among the classical references in this area are 
the textbook by Smith 26 and the papers 14, 15 by Hirsh and by Smale. 
Monotone systems are those for which trajectories preserve a partial ordering 
on states. They include the subclass of cMoperative systems (see e.g. mSHH] for 
recent contributions in the control literature) , for which different state variables 
reinforce each other (positive feedback) as well as more general systems in which 
each pair of variables may affect each other in either positive or negative, or even 
mixed, forms (precise definitions are given below). Although one may consider 
systems in which constant parameters (which can be thought of as constant 
inputs) appear, as done in the recent paper '22" for cooperative systems, the 
concept of monotone system has been traditionally defined only for systems with 
no external input (or "control") functions. 

The objective of this paper is to extend the notion of monotone systems 
to systems with inputs and outputs. This is by no means a purely academic 
exercise, but it is a necessary first step in trying to understand interconnections, 
especially including feedback loops, built up out of monotone components. 
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The successes of systems theory have been due in large part to its abihty 
to analyze complicated structures on the basis of the behavior of elementary 
subsystems, each of which is "nice" in a suitable input/output sense (stable, 
passive, etc), in conjunction with the use of tools such as the small gain theorem 
to characterize interconnections. 

On the other hand, one of the main themes and challenges in current molec- 
ular biology lies in the understanding of cell behavior in terms of cascade and 
feedback interconnections of elementary "modules" which appear repeatedly, 
see e.g. jl3) . Our work reported here was motivated by the problem of studying 
one such module type (closely related to, but more general than, the example 
which motivated HHDj and the realization that the theory of monotone systems, 
when extended to allow for inputs, provides an appropriate tool to formulate 
and prove basic properties of such modules. 

The organization of this paper is as follows. In Section |21 we introduce the 
basic concepts, including the special case of cooperative systems. Section O 
provides infinitesimal characterizations of monotonicity, relying upon certain 
technical points discussed in the Appendix. Cascades are the focus of Sectional 
and Section introduces the notions of static Input/State and Input/Output 
characteristics, which then play a central role in the study of feedback inter- 
connections and a small-gain theorem — the main result in the paper — in 
Section |H| We return to the biological example of MAPK cascades in Section |7| 
Finally, Section |2| shows the equivalence between cooperative systems and pos- 
itivity of linearizations. 

We view this paper as only the beginning of a what should be a fruitful 
direction of research into a new type of nonlinear systems. In particular, in [2] 
and we present results dealing with positive feedback interconnections and 
multiple steady states, and associated hysteresis behavior, as well as graphical 
criteria for monotonicity, and in |H1 El we describe applications to population 
dynamics and to the analysis of chemostats. 

2 Monotone Systems 

Monotone dynamical systems are usually defined on subsets of ordered Banach 
(or even more general metric) spaces. An ordered Banach space is a real Banach 
space B together with a distinguished nonempty closed subset K of B, its positive 
cone. (The spaces B which we study in this paper will all be Euclidean spaces; 
however, the basic definitions can be given in more generality, and doing so 
might eventually be useful for applications such as the study of systems with 
delays, as done in for systems without inputs.) The set K is assumed to 
have the following properties: it is a cone, i.e. aK C K for a G R+, it is convex 
(equivalently, since K is a cone, K + K C K), and pointed, i.e. Kri{—K) = {0}. 
An ordering is then defined by x\ ^ X2 iff xi — X2 £ K . Strict ordering is denoted 
by x\ >- meaning that x\ ^ X2 and x\ ^ X2. One often uses as well the 
notations -< and ^, in the obvious sense (x2 ^ xi means xi ^ 2:2). (Most of 
the results discussed in this paper use only that K \s a, cone. The property 
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K n {—K) = {0}, which translates into reflexivity of the order, is used only at 
one point, and the convexity property, which translates into transitivity of the 
order, will be only used in a few places.) 

The most typical example would be B = M" and K = K"q, in which case 
"xi y means that each coordinate of x\ is bigger or equal than the cor- 
responding coordinate of X2. This order on state spaces gives rise to the class 
of "cooperative systems" discussed below. However, other orthants in R" other 
than the positive orthant K = R"q are often more natural in applications, as 
we will see. 

In view of our interest in biological and chemical applications, we must 
allow state spaces to be non-linear subsets of linear spaces. For example, state 
variables typically represent concentrations, and hence must be positive, and 
are often subject to additional inequality constraints such as stoichiometry or 
mass preservation. Thus, from now on, we will assume given an ordered Banach 
space B and a subset X of B which is the closure of an open subset of B. For 
instance, X = B, or, in an example to be considered later, B = with the order 
induced by ivT = R>o x R<o, and X = {(x, y) £ R^ | x > 0, y > 0, x -t- y < 1}. 

The standard concept of monotonicity for uncontrolled systems is as follows: 
A dynamical system : R>o x X — > X is monotone if this implication holds: 
xi ^ X2 (j)(t,xi) >: (j){t,X2) for all < > 0. If the positive cone K is solid, i.e. 
it has a nonempty interior (as is often the case in applications of monotonicity, 
see e.g. one can also define a stricter ordering: Xi » X2 <^ x — y e int[K). 
(For example, when K = R>o, this means that every coordinate of xi is strictly 
larger than the corresponding coordinate of X2, in contrast to "xi >- X2" which 
means merely that some coordinate is strictly bigger while the rest are bigger 
or equal.) Accordingly, one says that a dynamical system : R>o y. X ^ X \s 
strongly monotone if xi >~ X2 implies that 0(i,xi) ^ (f>{t,X2) for all t >0. 

Next we generalize, in a very natural way, the above definition to controlled 
dynamical systems, i.e., systems forced by some exogenous input signal. In order 
to do so, we assume given a partially ordered input value space U. Technically, 
we will assume that U is a subset of an ordered Banach space Mu- Thus, for any 
pair of input values ui and U2 G W, we write ui >z W2 whenever ui — U2 € Ku 
where is the corresponding positivity cone in Bjy. In order to keep the 
notations simple, here and later, when there is no risk of ambiguity, we use the 
same symbol (^) to denote ordered pairs of input values or pairs of states. 

By an "input" or "control" we shall mean a Lebesgue measurable function 
u{-) : R>o — > U which is essentially bounded, i.e. there is for each finite interval 
[0,T] some compact subset C CU such that u{t) G C for almost all t G [0,T]. 
We denote by Uoo the set of all inputs. Accordingly, given two wi, U2 G Uoo, we 
write ui >: U2 if ui{t) > U2(t) for all i > 0. (To be more precise, this and other 
definitions should be interpreted in an "almost everywhere" sense, since inputs 
are Lebesgue-measurable functions.) A controlled dynamical system is specified 
by a state space X as above, an input set U, and a mapping </> : R>o x A x Uoo 
X such that the usual semigroup properties hold. (Namely, (j){0,x,u) — x and 
4>{t, (j){s, X, Ml), U2) = 4>{s + t, x, u), where v is the restriction of ui to the interval 
[0, s] concatenated with U2 shifted to [s, 00); we will soon specialize to solutions 
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of controlled differential equations.) 

We interpret (f>{t,£^,u) as the state at time t obtained if the initial state is ^ 
and the external input is u{-). Sometimes, when clear from the context, we write 
"a;(i, ^, u)" or just "x{t)" instead of ^, u). When there is no risk of confusion, 
we use "x" to denote states (i.e., elements oi X) as well as trajectories, but for 
emphasis we sometimes use ^, possibly subscripted, and other Greek letters, to 
denote states. Similarly, "u" may refer to an input value (element of U) or an 
input function (element ofUoo). 

Definition 2.1 A controlled dynamical system (j) : ]R>o x X x Uoo — > ^ is 
monotone if the implication below holds for all t > 0: 

UlhU2,XihX2 ^ 4'it,Xi,Ui) h (t)it,X2,U2). □ 

Viewing systems with no inputs as controlled systems for which the input 
value space U has just one element, one recovers the classical definition. This 
allows application of the rich theory developed for this class of systems, such 
as theorems guaranteeing convergence to equilibria of almost all trajectories, 
for strongly monotone systems (defined in complete analogy to the concept for 
systems with no inputs); see 

We will also consider monotone systems with outputs y — h{x). These are 
specified by a controlled monotone system (p together with a monotone {xi >^ X2 
=f- h{xi) > h{x2)) map h : X ^ y, where 3^, the set of measurement or output 
values, is a subset of some ordered Banach space B^;. We often use the shorthand 
y(t,x,u) instead of h{(j){t^x^u)), to denote the output at time t corresponding 
to the state obtained from initial state x and input u. 

From now on, we will specialize to the case of systems defined by differential 
equations with inputs: 

X = f{x,u) (1) 

(see [37] for basic definitions and properties regarding such systems). We make 
the following technical assumptions. The map / is defined on X xU, where X 
is some open subset of B which contains X, and B = R" for some integer n. We 
assume that /(x, u) is continuous in (x, u) and locally Lipschitz continuous in x 
locally uniformly on u. This last property means that for each compact subsets 
Ci C X and C2 QU there exists some constant k such that |/(^, u) — /(C, u)\ < 
fc 1^ — CI for all £ Ci and all u e C2. (When studying interconections, 
we will also implicitly assume that / is locally Lipschitz in {x,u), so that the 
full system has unique solutions.) In order to obtain a well-defined controlled 
dynamical system on X, we will assume that the solution x{t) = 4){t,XQ,u) of 
X — f{x, u) with initial condition x(0) = xq is defined for all inputs u{-) and all 
times t > 0. This means that solutions with initial states in X must be defined 
for all t > (forward completeness) and that the set X is forward invariant. 
(Forward invariance of X may be checked using tangent cones at the boundary 
of X, see the Appendix.) 

From now on, all systems will be assumed to be of this form. 
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3 Infinitesimal Characterizations 



For systems ^ defined by controlled differential equations, we will provide an 
infinitesimal characterization of monotonicity, expressed directly in terms of 
the vector field, which does not require the explicit computation of solutions. 
Our result will generalize the well-known Kamke conditions, discussed in |26|. 
Chapter 3. We denote V := intX, the interior of X (recall that X is the closure 
of V) and impose the following approximability property (see [2^1; Remark 3.1.4): 
for all ^1,^2 G X such that ^ there exist sequences {5i},{^2} £ ^ such 
that y Q for all i and and Q ^ ^2 as i —>■ oo. 

Remark 3.1 The approximability assumption is very mild. It is satisfied, in 
particular, if the set X is convex, and, even more generally, if it is strictly 
star-shaped with respect to some interior point ^, , i.e., for all ^ G X and all 

< A < 1, it holds that A^-|- (1 — A)^* £ V. (Convex sets with nonempty interior 
have this property with respect to any point 6 V, since A^ -I- (1 — A)^* G 
Q := A^ -I- (1 — A)V C X (the inclusion by convexity) and the set Q is open 
because 77 (-^ A^ + (1 — A)?7 is an invertible affine mapping.) Indeed, suppose 
that ^1 — G K, pick any sequence A* y 1, and define Cj ■= + (1 ~ ^^)^* 
for j — 1,2. These elements are in V, they converge to ^1 and ^2 respectively, 
and each Ci ~ £,2 = ^HCi ~ C2) belongs to K because if is a cone. Moreover, a 
slightly stronger property holds as well, for star-shaped X, namely: if ^1, ^2 G X 
are such that ^1 ^ ^2 and if for some linear map L : M'' it holds that 
L^i = L^2, then the sequences {£,{}, {£,2} can be picked such that L^l — for 
all i; this follows from the construction, since L{£^1 — — A*L(^i — ^2) — 0. 
For instance, L might select those coordinates which belong in some subset 

1 ^ {1, • ■ • in}. This stronger property will be useful later, when we look at 
boundary points. □ 

The characterization will be in terms of a standard notion of tangent cone, 
studied in nonsmooth analysis: Let 5* be a subset of a Euclidean space, and 
pick any ^ G 5. The tangent cone to S at £ is the set T^S consisting of all 
limits of the type limi_,oo (fi ~ such that £,i^£ and ti \ 0, where "^^ ^" 
means that — > f as i — > cx) and that £ S for all i. Several properties of 
tangent cones are reviewed in the Appendix. The main result in this section is 
as follows. 

Theorem 1 The system 0J) is monotone if and only if for all ^1,^2 G V: 

6 h 6, uihu2^ /(6,"i) - /(6,"2) G T^,-^,K (2) 
or, equivalently, 

- 6 G dK, uihu2^ f{£i-ui) - /(6,"2) G T^,-i,K. (3) 

Theorem^ is valid even if the relation "xi ^ X2 iff 2^1 — a;2 G K" is defined 
with respect to an arbitrary closed set K, not necesssarily a closed convex cone. 
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Our proof will not use the fact that is a a closed convex cone. As a matter 
of fact, we may generalize even more. Let us suppose that an arbitrary closed 
subset T <Z X X X has been given and we introduce the relation, for ^i, ^2 G X: 

We then define monotonicity just as in Definition 12.11 A particular case is 
r = r(K), for a closed set K (in particular, a convex cone), with (^1, ^2) G r(_ftr) 
if and only if xi — X2 G K. Such an abstract setup is useful in the following 
situation: suppose that the state dynamics are not necessarily monotone, but 
that wc are interested in output-monotonicity: if ui >: U2 and xi ^ X2, then 
the outputs satisfy h{(j)(t, xi,ui)) ^ h{(j){t,X2,U2)) for all t. This last property 
is equivalent to the requirement that xi, ui), X2, U2)) G T, where T is 
the set of all pairs of states (^1,^2) such that h{^i) >z h{£^2) in the output-value 
order; note that F is generally not of the form T{K). In order to provide a 
characterization for general F, we introduce the system with state-space X x X 
and input- value set U^^^ whose dynamics 

i = (4) 

are given, in block form using x = {xi,X2) d X x X and u = (mi,U2) G U^'^\ 
as: ii = f(xi,ui), ±2 = fix2,U2) (two copies of the same system, driven by 
the different Ui's). We will prove the following characterization, from which 
Theorem n will follow as a corollary: 

Theorem 2 The system 0) is monotone if and only if, for all ^1,^2 G V: 

^1 h 6 and uihu2 /''l(e,M) G T^F . (5) 

Returning to the case of orders induced by convex cones, we remark that 
the conditions given in Theorem ^ may be equivalently expressed in terms of a 
generalization, to systems with inputs, of the property called quasi-monotonicity 
(see for instance ^| 1201 ESI 1^ IS EH and references therein): the system Q 
is monotone if and only if 

Ci h 6, ui hu2,C& K*, and (C^i) - (C,6) 

=> (c,/(a,wi)) > (c,/(6,«2)) ^ ' 

(it is enough to check this property for ^1 — ^2 G OK), where K* is the set 
of all C G M" so that A;) > for all k G K. The equivalence follows from 
the elementary fact from convex analysis that, for any closed convex cone K 
and any element p £ K, TpK coincides with the set of G M" such that: 
= and C G if* {v, () > 0. An alternative proof of TheoremQlfor the 
case of closed convex cones K should be possible by proving ^ first, adapting 
the proofs and discussion in pS). 

Condition © can be replaced by the conjunction of: for all ^ and all ui h U2, 
/(C,'^i)-/(e,M2) Gir,andforallM,Ci ^ 6, and (CCi) = (C,^), iCJi^uu)) > 
(C, /(^2, u)) (a similar separation is possible in Theorem^. 
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The proofs of Theorems Q] and |3 are given later. Fhst, we discuss the appH- 
cabiHty of this test, and we develop several technical results. 

We start by looking at a special case, namely K = M"q and Ku = Ili>Q (with 
Mjj =^ M™). Such systems are called cooperative systems. 

The boundary points of K are those points for which some coordinate is 
zero, so "^i — ^2 G dK" means that ^ ^2 and = ^2 for at least one 
i e {1, . . . , 7i}. On the other hand, if ^1 ^ ^2 and = for i G / and > 
for i e {l,...,n}\ / , the tangent cone T^-^^^^K consists of all those vectors 
V — {vi, . . . ,Vn) 6 K" such that Vi > for i ^ I and Vi is arbitrary in R 
otherwise. Therefore, Property (O translates into the following statement: 



holding for all i = 1, 2, . . . n, all ui, U2 £ l^, and all ^1, ^2 G V (where denotes 
the ith component of /). In particular, for systems with no inputs x — f{x) one 
recovers the well-known characterization for cooperativity (cf. jH]): "■^i h £,2 



and = C2 implies f{Ci) > fHh)" must hold for aU i = 1, 2, . . . n and all 

6,6 ev. 



When X is strictly star-shaped, and in particular if X is convex, cf. Re- 
mark im one could equally well require condition ||7J) to hold for all 6j 6 ^ 
Indeed, pick any ^1 >r 61 and suppose that £^1 = ^2 for i G / and 6 > C2 fo^ 
i e {1, . . . ,n} \ /. Pick sequences — » 6 and ^f' ^2 so that, for all fc, 
Ci, ^2 G "l^i Ci ^ C2 and (^f)* = (^2)* for i e / (this can be done by choos- 
ing an appropriate projection L in Remark Since the property holds for 
elements in V, we have that r(^i,ui) > P{S.\.U2) for aU fc 1, 2, . . . and 
all i E I. By continuity, taking limits as fc — > 00, we also have then that 
/'(6, ui) > /*(6: ^2). On the other hand, ifU also satisfies an approximability 
property, then by continuity one proves similarly that it is enough to check the 
condition (O for ui, U2 belonging to the interior W ~ int W. In summary, we can 
say that if X and U are both convex, then it is equivalent to check condition 
for elements in the sets or in their respective interiors. 

One can also rephrase the inequalities in terms of the partial derivatives of 
the components of /. Let us call a subset S of an ordered Banach space order- 
convex ("p-convex" in 2()[ ) if, for every x and y in S with x ^ y and every 
< A < 1, the element Aa; -I- (1 — \)y is in 5*. For instance, any convex set 
is order-convex, for all possible orders. We have the following easy fact, which 
generalizes Remark 4.1.1 in |2t)) : 

Proposition 3.2 Suppose that l&u = M™, U satisfies an approximability prop- 
erty, and both V and W — intU are order-convex (for instance, these properties 
hold if both V and U are convex). Assume that / is continuously differentiable. 
Then, the system ^ is cooperative if and only if the following properties hold: 



6 ^ 6 and £,1 = Q and wi ^ W2 ^ 

r(6,ui)-r(6,"2) > 



(7) 



Tf-{x,u)>0 Vx e V, Vm e W, Vi ^ j 
ox^ 

dp 

-i-(a;, u) > Wx G X, WueW 



(8) 



(9) 
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for all i e {1, 2, . . . n} and all j e {1, 2, . . . m}. 

Proof: We will prove that these two conditions are equivalent to condi- 
tion ||7J| holding for alH = 1, 2, . . . n, all ui,U2 G W, and all ■^i, ^2 G V. Necessity 
does not require the order-convexity assumption. Pick any ^ G V, w G W, and 
pair i ^ j. We take ^1 — ^, ui — U2 = u, and 1^2 (A) = C + ^^j^ where is 
the canonical basis vector having all coordinates ^ j equal to zero and its jth 
coordinate one, with A < near enough to zero so that C2(A) G V. Notice that, 
for all such A, ^ > ^2 (A) and $1 = 6(A)' (in fact, = ^(A)'^ for all £ ^ j). 
Therefore condition Q gives that p[£,i,u) > /*(6(A), m) for all negative A « 0. 
A similar argument shows that p{S,i,u) < /*(C2(A),u) for all positive A « 0. 
Thus /^(^(A),^) is increasing in a neighborhood of A = 0, and this implies 
Property ©• A similar argument establishes Property ©■ 

For the converse, as in |26| . we simply use the Fundamental Theorem of 

Calculus to write T (6, wi) - /'(Ci, «i) as E;=i 1^(6 + - 6), "i)(e^ - 

^^)<ir and ^(6, "2) - r(6, "1) as /q^ Ejli |£-(6, W2 -f - u{))(m^2 ^ "i)^^^ 
for any i — 1, 2, ... n, wi, U2 G W, and 6, ^ G V. Pick any i G {1,2,... n}, 
ui,U2 G W, and G V, and suppose that ^ ^ 6, = and ui ^ M2 

We need to show that /*(6, M2) < f^{^i,ui)- Since the first integrand vanishes 
when j ^ i, and also dp /dx^ > and ^2 ~ ^1 ^0 fo^' J 7^ it follows that 
f^{£,2,ui) < P{^i,ui). Similarly, the second integral formula gives us that 
/'(?2, U2) < r{^2:Ui), completing the proof. ■ 
For systems without inputs. Property ||SJ) is the well-known characterization 

> for all i ^ j" of cooperativity. Interestingly, the authors of use this 
property, for systems as in but where inputs u are seen as constant param- 
eters, as a definition of (parameterized) cooperative systems, but monotonicity 
with respect to time-varying inputs is not exploited there. The terminology 
"cooperative" is motivated by this property: the different variables have a 
positive influence on each other. 

More general orthants can be treated by the trick used in Section 3.5 in |26| . 
Any orthant K in K" has the form K^''\ the set of all x G R" so that {-l^'xt > 
for each i = 1, . . . , 71, for some binary vector e — (ei, . . . , e„) G {0, 1}". Note 
that = FK?io, where P : R" ^ R" is the linear mapping given by the 

matrix P = diag ((— 1)^"^, . . . , (— 1)"^"). Similarly, if the cone defining the 
order for U is an orthant K^^\ we can view it as QR^q, for a similar map 
Q — diag ((— l)''i, . . . , (— 1)'^"). Monotonicity of i = f{x,u) under these orders 
is equivalent to monotonicity of i = g{z, v), where g{z, v) = Pf{Pz, Qv), under 
the already studied orders given by R"g and R>o. This is because the change of 
variables z{t) = Px{t), v{t) = Qu{t) transforms solutions of one system into the 
other (and viceversa), and both P and Q preserve the respective orders (^ ^ 
is equivalent to (P^)' > (PC2)' for all i G {!,... ,?^}, and similarly for input 
values). Thus we conclude: 

Corollary 3.3 Under the assumptions in Proposition 13.21 and for the orders 
induced from orthants K'^'^^ and K''^\ the system is monotone if and only if 
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the following properties hold for all i ^ j: 

dp 

> VxeV, VugW, (10) 

8 P 

{-IY^+^^ -^{x,u) >0 VxeX, VweW (11) 

for all i e {1, 2, . . . n} and aU j e {1, 2, . . . m}. □ 

Graphical characterizations of monotonicity with respect to orthants are 
possible; see 'A. for a discussion. The conditions amount to asking that there 
should not be any negative (non-oriented) loops in the incidence graph of the 
system. 

Let us clarify the above definitions and notations with an example. We 
consider the partial order ^ obtained by letting K = ]R<o x M>o. Using the 
previous notations, we can write this as K = K''^\ where e = (1,0). We 
will consider the input space U = K>o, with the standard ordering in R (i.e., 
Ku = ]R.>0 5 or Ku = A'f''' with 5 — (0)). Observe that the boundary points of 
the cone K are those points of the forms p = (0, a) or g = (—a, 0), for some a > 0, 
and the tangent cones are respectively TpK = ]R<o x R and TpK = M x M>o, 
see Fig. ^ Under the assumptions of Corollary 13.31 a system is monotone 





p 








q 





Figure 1: Example of cone and tangents 

with respect to these orders if and only if the following four inequalities hold 
everywhere: 

Tf2<0,/y<0,^<0,^>0. 

ox ox Ou ou 

A special class of systems of this type is afforded by systems as follows: 



= -uOiix^) + e2{l -x^ - x^) 
P =uez{l-x^ -x'^)~ei{x^) 



^^f{x\P,u) (12) 



where the functions 9i have strictly positive derivatives and satisfy 9i{Q) = 0. 
The system is regarded as evolving on the triangle X = A := : x^ > 

0, x"^ > 0,x^ + x^ < 1}, which is easily seen to be invariant for the dynamics. 
Such systems arise after restricting to the affine subspace x'^ + x* + x'^ = 1 
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and eliminating the variable x* in the set of three equations — ~u9i{x^) + 
e2{x*),x* = uei{x^)-02{x*)-ue:i(x*) + ei{x'^),x^ = uez{x*)-ei{x'^), and they 
model an important component of cellular processes, see e.g. |12[ [T^ and the 
discussion in Sectional (The entire system, before eliminating x* , can also be 
shown directly to be monotone, by means of the change of coordinates yi = x^ , 
y2 = x^ + X* , = x^ + X* + x'^ . As such, it, and analogous higher-dimensional 
signaling systems, are "cooperative tridiagonal systems" for which a rich theory 
of stability exists; this approach will be discussed in future work.) The following 
fact is immediate from the above discussion: 

Lemma 3.4 The system (|12ll is monotone with respect to the given orders. □ 

Remark 3.5 One may also define competitive systems as those for which ui ^ 
U2 and xi ^ X2 imply (j)(t-,xi,ui) >r <p(t,X2,U2) for t < 0. Reversing time, one 
obtains the characterization: "^1—^2 G dK and ui ^ U2 ^ f{£,2, ^2)— /(^i, wi) G 
oi'' for the special case of the positive orthant, ^{x,u) < for all 

X € X and all u G U {i j) together with §{j{x, u) < for all x G X and all 
M £ W for all i e {1, 2, . . . n} and aU j e {1, 2, . . . m}. □ 

We now return to the proof of Theorem ^ 

Lemma 3.6 The set V is forward invariant for i.e., for each ^ £ V and each 
u G Uao: Ht, ^, u) e V for aU t>0. 

Proof: Pick any ^ G V, w £ Uoc, and to > 0. Viewing (^^l as a system 
defined on an open set of states X which contains X, we consider the mapping 
a : V — > B given by a{x) = 0(ioj x, u) (with the same u and to). The image of 
a must contain a neighborhood W of ^' = a{^); see e.g. Lemma 4.3.8 in |27|. 
Thus, W 'Z X, which means that ^' £ intX, as desired. ■ 

Remark 3.7 The converse of Lemma [3.61 is also true, namely, if i = f{x,u) 
is a system defined on some neighborhood X oi X and if V = int X is forward 
invariant under solutions of this system, then X is itself invariant. To see this, 
pick any £, € X and a sequence — + 1^ of elements of V. For any t, i, and u, 
(j){t, £,\u) & V, so (f>{t, u) = lim,;_,oo Ht, S.\ u) e clos V = X. □ 

We introduce the closed set U^^^ consisting of all (ui, U2) eU xU such that 

[21 

ui y "2- We denote by Uixi the set of all possible inputs to the composite 
system Q i.e., the set of all Lebesgue- measurable locally essentially bounded 
functions u : [0, 00) U^^^. Since by Lemma Hi fil the interior V of X is forward 
invariant for it holds that (jP^ {t, ^, u) belongs to V x V whenever ^ G V x V 
and u € . 

Observe that the definition of monotonicity amounts to the requirement that: 
for each ^ G F, and each u G , the solution cjP'^ (t, ^, u) of ^ with initial 
condition x{0) — ^ belongs to F for all t > (forward invariance of F with 
respect to (jUl). Also, the set Fq :== Ff] (V x V) is closed relative to V x V. The 
following elementary remark will be very useful: 
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Lemma 3.8 The system ^ is monotone if and only if the set Tq is forward 
invariant for the system I^J restricted to V x V. 

Proof: We must show that monotonicity is the same as: € Tq and 
u G (t, ^, u) G To for all t > 0." Necessity is clear, since if the system 

is monotone then (jP^ {t, ^, u) e F holds for all ^ G F D Fq and all t > 0, and we 
already remarked that G VxV whenever^ G Fq. Conversely, pick any 

^ G F. The approximability hypothesis provides a sequence {^*} C Fq such that 
f ^ ^ as i -> cx). Fix any u G Z^S and any t > 0. Then cj)^'^^ (t, f , u) G Fq C F 
for all i, so taking limits and using continuity of on initial conditions gives 
that </)[^l(i,^,u) G F, as required. ■ 

Lemma 3.9 For any ^ — (^1,^2) G Fq and any u = (ui , U2) the following 

three properties are equivalent: 

/(6,"i)-/(6,^^2) G r^.^^.x (13) 

e T^Fo (14) 
f^'\^,u) E T^r . (15) 

Proof: Suppose that p3|) holds, so there are sequences ti \0 and {77'} C K 
such that ^ ^1 — ^2 and 

Uv'-i^i~^2)) - /(a,wi)-/(6,«2) (16) 

as i — > 00. Since V is open, the solution x{t) = (/)(t, of i = f(x,u) with 
input u = ui and initial condition x(0) — ^1 takes values in V for all sufficiently 
small t. Thus, restricting to a subsequence, we may without loss of generality 
assume that := x(ti) is in V for all i. Note that, by definition of solution, 
(a) (l/ti)('fi ~ Ci) ^ /(^ijWi) as i ^ 00, and subtracting l|l()|l from this we 
obtain that (b) (l/ti)(C2 ~ ^2) ^ /(^2, U2) as z ^ 00, with ^2 ^ Since 

^1 — > ^1 and 77' ^ ^1 — ^2 as i ^ 00, the sequence ,^2 converges to ^2 G V. 
Using once again that V is open, we may assume without loss of generality that 

G V for aU i. Moreover, Ci " ^1 = e i.e., f := e F for aU i, 

which means that is in Fq for all i, and, from the previous considerations, (c) 
~0 ^ {f{S,i,ui),f{^2,U2)) as i — > (X), so that Property ifTH) is verified. 
Since Fq C F, also Property (fTK)) holds. 

Conversely, suppose that Property 1)15(1 holds. Then there are sequences 
ti\0 and C ■= (^1, CI) e F with f ^ C such that (c) holds. Since ^ G V x V, 
we may assume without loss of generality that G Fq for all i, so that we also 
have Property (|14|l . Coordinatewise, we have both (a) and (b), which subtracted 
and defining 77* :~ £,{ — £,2 give (|16ll : this establishes Property (|13() . ■ 
Proofs of Theorems ^ and |2] 

Suppose that the system is monotone, and fix any input-value pair u*^ = 
(u?,u^) G WPl. Lemma EHl 

says that the set Fq is forward invariant for the 
system (0J restricted to V x V. This implies, in particular, that every solution 
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of the differential equation x — f^'^\x,u^) with x{0) £ Tq remains in Tq for all 
t >0 (where we think of u'^ as a constant input). We may view this differential 
equation as a (single-valued) differential inclusion x G F{x) on V x V, where 
i^(^) = {/'^'(C, w^)}, for which the set Fq is strongly invariant. Thus, Theorem^ 
in the Appendix implies that F(^) C T^Tq for all ^ G Fq. In other words, 
Property p4(l . or equivalently Property p5|l holds, at all ^ G Fq, for the given 
It = Since was an arbitrary element of U^^\ Property © follows. By 
LemmaEl /(a,"?) - /l^,"") ^ T^i-^i^ for aU (6,6) e Fq and this u°. So 
Property Q also follows. 

Conversely, suppose that (0) holds or jsj holds. By Lemma [3.91 we know 
that Property holds for all (6:6) £ and aU (mi,M2) G U^^^. To show 
monotonicity of the system JQ), we need to prove that Fq is invariant for the 
system (0} when restricted to V x V. So pick any G Fq, any G U^, and any 
t° > 0; we must prove that ^I^l (t°, u") G Fq. The input function m° being 
locally bounded means that there is some compact subset C such that u{t) 
belongs to the compact subset — W'^' p| C x C of Bj^ x B;^, for (almost) 
all t G [0,t°]. We introduce the following compact- valued, locally bounded, and 
locally Lipschitz set- valued function: -F'c(f) •= {/'^'(?,''^) I u G U^} on V X V. 
We already remarked that Property holds, i.e., {/'^^(6^*) I ^ & W'^'} C 
T^Fq, for all (6,6) £ Tq, so it is true in particular that Fc{£,) C T^Fq. Thus, 
Theorem 0] in the Appendix implies that Fq is strongly invariant with respect 
to Fq. Thus, since x{-) = (•, u*^) restricted to [0,t°] satisfies x G Fc{x), 
we conclude that x{t^) G Fq, as required. 

Finally, we show that (O and Q are equivalent. Since (j^J is a particular 
case of (|21), we only need to verify that /(6,'"i) — /(6,'"2) G T^^-^^K when 
6 ~ 6 G intii'. This is a consequence of the general fact that T^S — R" 
whenever ^ is in the interior of a set 5*. I 

4 Cascades of monotone systems 

Cascade structures with triangular form 

Xl = fi{xi,X2,...,XN,u) 
X2 f2{x2,--.,XN,u) 

; : (1^) 

XN = /at (a: AT, u) 

are of special interest. A simple sufficient condition for monotonicity of systems 
p7|) is as follows. 

Proposition 4.1 Assume that there exist positivity cones Ki,K2, ■ ■ ■ ^Km+i 
(of suitable dimensions) so that each of the -subsystems in (|17|l is a controlled 
monotone dynamical system with respect to the Xi-induced partial order (as far 
as states are concerned) and with respect to the -f^i+i, . . . , i^Tv+i-induced partial 
orders as far as inputs are concerned. Then, the overall cascaded interconnection 
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H17|) is monotone with respect to the order induced by the positivity cone Ki x 
K2 X ... X Kn on states and -f^jv+i on inputs. 

Proof: We first prove the result for the case N — 2: Xi = fi{xi,X2,u), 
^2 = f2{x2,u). Let ^1 and ^2 be the partial orders induced by the cones 
Ki,K2 and on inputs. Pick any two inputs ^„ u^. By hypothesis we 
have, for each two states = and I'' = {£.'[,^2), that ^2 C2 imphes 

02(^,^21""°) ^2 02(^,^21'"'') for all t > as well as, for all functions X2 and 
that ^1 and ^2 implies (l)i(t,^^,x^,u'') hi ^1, 4, u'') for 
all t > 0. Combining these, and defining K := Ki x if 2 and letting ^ denote 
the corresponding partial order, we conclude that y implies (j){t, u°) ^ 
u*) for all t > 0. The proof for arbitrary N follows by induction. ■ 

5 Static Input/State and Input/Output Char- 
acteristics 

A notion of "Cauchy gain" was introduced in |28| to quantify amplification of 
signals in a manner useful for biological applications. For monotone dynamical 
systems satisfying an additional property, it is possible to obtain tight estimates 
of Cauchy gains. This is achieved by showing that the output values y{t) cor- 
responding to an input u(-) are always "sandwiched" in between the outputs 
corresponding to two constant inputs which bound the range of u{-). This ad- 
ditional property motivated our looking at monotone systems to start with; we 
now start discussion of that topic. 

Definition 5.1 We say that a controlled dynamical system is endowed with 
the static Input/State characteristic 

if for each constant input u{t) = u there exists a (necessarily unique) globally 
asymptotically stable equilibrium kx{u). For systems with an output map y = 
h{x), we also define the static Input/Output characteristic as ky{u) := h{kx{u)), 
provided that an Input/State characteristic exists and that h is continuous. □ 

The paper [221 (see also |2J| for linear systems) provides very useful results 
which can be used to show the existence of I/S characteristics, for cooperative 
systems with scalar inputs and whose state space is the positive orthant, and in 
particular to the study of the question of when kx{u) is strictly positive. 

Remark 5.2 Observe that, if the system ^ is monotone and it admits a static 
Input/State characteristic kx^ then k^ must be nondecreasing with respect to the 
orders in question: w ^ w in W implies kx{u) h kx{v). Indeed, given any initial 
state ^, monotonicity says that (jj^t, ^, u) >z (l){t, ^, v) for all where u{t) = u 
and v{t) = V. Taking limits as i — > 00 gives the desired conclusion. □ 



13 



Remark 5.3 (Continuity of k^) Suppose that for a system there is a map 
kx '■ U ^ X with the property that kx {u) is the unique steady state of the system 
X = f{x,u) (constant input u = u). When kx{u) is a globally asymptotically 
stable state for x = f{x,u), as is the case for I/S characteristics, it follows 
that the function kx must be continuous, see Proposition 15.51 below . However, 
continuity is always true provided only that kx be locally bounded, i.e. that 
kxiV) is a bounded set whenever V '^U is compact. This is because kx has a 
closed graph, since kx{u) = x means that f{x,u) = 0, and any locally bounded 
map with a closed graph (in finite-dimensional spaces) must be continuous. 
(Proof: suppose that Ui — > u, and consider the sequence Xi — kx{ui)', by local 
boundedness, it is only necessary to prove that every limit point of this sequence 
equals kx{u). So suppose that Xi^ x'; then {ui.,Xi-) {u,x'), so by the 
closedness of the graph of kx we know that {u,x') belongs to its graph, and 
thus desired.) Therefore, local boundedness, and hence continuity of 

kxi would follow if one knows that kx is monotone, so that k{[a,b]) is always 
bounded, even if the stability condition does not hold, at least if the order 
is "reasonable" enough, as in the next definition. Note that ky is continuous 
whenever kx is, since the output map h has been assumed to be continuous. □ 

Under weak assumptions, existence of a static Input/State characteristic 
implies that the system behaves well with respect to arbitrary bounded inputs 
as well as inputs that converge to some limit. For convenience in stating results 
along those lines, we introduce the following terminology: The order on X is 
bounded if the following two properties hold: (1) For each bounded subset S C 
X, there exist two elements a, 6 G B such that S C [a, b] = {x ^ X : a ^ x ^ b} , 
and (2) For each a, 6 G B, the set [a, b] is bounded. Boundedness is a very mild 
assumption. In general. Property 1 holds if (and only if) K has a nonempty 
interior, and Property 2 is a consequence of Kf] —K = {0}. (The proof is an 
easy exercise in convex analysis.) 

Proposition 5.4 Consider a monotone system which is endowed with a 
static Input/State characteristic, and suppose that the order on the state space 
X is bounded. Pick any input u all whose values u(t) lie in some interval 
[c,d] C U. (For example, u could be any bounded input, if K is an orthant in 
M", or more generally if the order in U is bounded.) Let x{t) = (j>{t, ^, u) be any 
trajectory of the system corresponding to this control. Then {x{t),t > 0} is a 
bounded subset of X. 

Proof: Let xi{t) — (j3{t,S_,d), so xi{t) kx{d) as i ^ oo and, in particular, 
a;i(-) is bounded; so (bounded order), there is some 6 G B such that xi{t) < b 
for all t > 0. By monotonicity, x{t) — 0(t, ^, u) ^ (f>{t,£^,d) = xi{t) ^ b for 
all t > 0. A similar argument using the lower bound c on it shows that there 
is some a G B such that a ^ x{t) for all t. Thus x{t) G [a, b] for all t, which 
implies, again appealing to the bounded order hypothesis, that x{-) is bounded. 

■ 

Certain standard facts concerning the robustness of stability will be useful. 
We collect the necessary results in the next statements, for easy reference. 
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Proposition 5.5 If Q is a monotone system which is endowed with a static 
Input/State characteristic k^, then is a continuous map. Moreover for each 
u Gh(, X = kx{u), the foUowing properties hold: 

1. For each neighborhood P of i in X there exist a neighborhood Pq of x in 
X, and a neighborhood Qq of u in U, such that <j>{t, £_,u) ^ P for all t > 0, 
all f £ Pq, and all inputs u such that u{t) G Qo for all t > 0. 

2. If in addition the order on the state space X is bounded, then, for each 
input u all whose values u{t) lie in some interval [c, d] C U and with 
the property that u{t) — > u, and all initial states £, G X , necessarily 

x(t) = (f){t, £^,u) X as t oo. 

Proof: Consider any trajectory x{t) — (j){t, ^, u) as in Property 2. By Propo- 
sition]^] we know that there is some compact C C B such that x{t) e C for 
all t > 0. Since X is closed, we may assume that C C X. We are therefore 
in the following situation: the autonomous system x = f{x,u) admits X clS Si 
globally asymptotically stable equilibrium (with respect to the state space X) 
and the trajectory x{-) remains in a compact subset of the domain of attraction 
(of X = f{x,u) seen as a system on an open subset of B which contains X). 
The "converging input converging state" property then holds for this trajectory 
(see 1211, Theorem 1, for details). Property 1 is a consequence of the same re- 
sults. (As observed to the authors by German Enciso, the CICS property can 
be also verified as a consequence of "normality" of the order in the state space.) 
The continuity of k^ is a consequence of Property 1 . As discussed in r!,emark l5.3l 
we only need to show that k^ is locally bounded, for which it is enough to show 
that for each u there is some neighborhood Qo of u and some compact subset 
P of X such that k^iiJ,) € P for all fj, € Qq. Pick any u, and any compact 
neighborhood P of a; = kx{u). By Property 1, there exist a neighborhood Pq of 
X in X, and a neighborhood Qq of u in U, such that (f){t, ^, u^) S P for alH > 
whenever ^ g Pq and u^(i) = with fi £ Qq- In particular, this implies that 
fca;(/i) — limj^oo 4>{t,x,u^) e P, as required. ■ 

Corollary 5.6 Suppose that the system x — f{x,u) with output y — h{x) is 
monotone and has static Input /State and Input /Output characteristics k^, ky, 
and that the system i = g{z,y) (with input value space equal to the output 
value space of the first system and the orders induced by the same positivity 
cone holding in the two spaces) has a static Input /State characteristic A;^, it 
is monotone, and the order on its state space Z is bounded. Assume that the 
order on outputs y is bounded, Then the cascade system 

X = f{x,u), y^h{x) 

is a monotone system which admits the static Input/State characteristic k{u) = 
{kx{u),k^{ky{u))). 
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Proof: Pick any u. We must show that k{u) is a globally asymptotically 
stable equilibrium (attractive and Lyapunov-stable) of the cascade. Pick any 
initial state ^) of the composite system, and let x{t) — 4>x{t, u) (input con- 
stantly equal to u), y(t) — h{x{t)), and z{t) — 4>z{tX,y)- Notice that x{t) — > x 
and y{t) = h{x{t)) y = ky{u), so viewing y as an input to the second system 
and using Property 2 in Proposition 15.51 we have that z(t) — > z = kz{ky{u)). 
This establishes attractivity. To show stability, pick any neighborhoods Px 
and Pz of X and z respectively. By Property 1 in Proposition 15.51 there are 
neighborhoods Pq and Qq such that G Pq and y{t) £ Qo for all i > im- 
ply 4)z{tXiV) e Pz for all t > 0. Consider Pi := PxC\h^^{Qo)i which is a 
neighborhood of x, and pick any neighborhood P2 of x with the property that 
0(i, ^, u) S Pi for all £, E P2 and alH > (stability of the equilibrium x). Then, 
for all (C,C) £ P2 X Pq, x(t) = <j)xit,£,,u) & Pi (in particular, a;(f) G P^) for 
all t > 0, so y{t) — h{x{t)) e Qo, and hence also z{t) = (l)z{t,(^,y) e Qz for all 
t>0. m 
In analogy to what usually done for autonomous dynamical systems, we 
define the ll-limit set of any function a : [0, 00) A, where A is a topological 
space (we will apply this to state-space solutions and to outputs) as Q[a\ := 
{a € A \ 3 tk ^ +00 s.t. linife^+oo ct(ifc) = a} (in general, this set may be 
empty). For inputs u G Woo, we also introduce the sets £<[u] (respectively, 
yC>[u]) consisting of all ^ E U such that there are tk -foo and iik ^J' 
(fc +00) with /ij. E U so that u(t) >^ (respectively /x^, > u{t)) for all 
t > tk- These notations are motivated by the following special case: Suppose 
that we consider a SISO (single-input single-output) system, by which we mean 
a system for which B^^ = R and My — R, taken with the usual orders. Given 
any scalar bounded input u(-), we denote Minf := liminft^+oo u(t) and Usup := 
limsupt^_,_oQ u{t). Then, Uinf € i3<[M] and Msup E J~'>[u], as follows by definition 
of lim inf and lim sup. Similarly, both liminft^+00 2/(0 and limsupj^^^^ y{t) 
belong to il[y], for any output y. 

Proposition 5.7 Consider a monotone system with static I/S and I/O 
characteristics kx and ky. Then, for each initial condition ^ and each input 
u, the solution x{t) ~ (j){t,S,,u) and the corresponding output y{t) — h{x(t)) 
satisfy: 

kx{C<[u]) ^ n[x] ^ kx{C>[u]) 
ky{C<[u]) ^ n[y] ^ ky{£>[u]) . 

Proof: Pick any ^, u, and the corresponding x{-) and y(-), and any element 
fj. E C< [u]. Let tk +00, Hk — > Ml with all /Ufc E U, and u{t) > fik for all t > tk- 
By monotonicity of the system, for t > we have: 

x{t,£„u) = x(t-tk,x{tk,£„u),u{- + tk)) 
>z x{t-tk,x{tk,tu),fik) ■ 

In particular, if x{si) ( for some sequence si —^ 00, it follows that ( }z 
lime^ao x{s£ — tk, x{tk, ^,u), ^k) — kx{iJ-k)- Next, taking limits as /c — ^ 00, and 
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using continuity of , this proves that C, '^k^ {fJ.) ■ This property holds for every 
elements C G ^[2;] f^nd fi G >C<[u], so we have shown that k^ {C<[u\) ^ fl[x]. 
The remaining inequalities are all proved in an entirely analogous fashion. ■ 

Proposition 5.8 Consider a monotone SISO system with static I/S and 
I/O characteristics kx{-) and fcy(-). Then, the I/S and I/O characteristics are 
nondecreasing, and for each initial condition ^ and each bounded input u(-), the 
following holds: 

ky{uini) < limmft^+oo yit,S.,u) 

If, instead, outputs are ordered by >, then the I/O static characteristic is non- 
increasing, and for each initial condition ^ and each bounded input u(-), the 
following inequality holds: 

kyiusup) < liminf(^+oo2;(i, ") 

< limsupt^+^ < fcy(Minf) . 

Proof: The proof of the first statement is immediate from Proposition 15. 71 
and the properties: Minf 6 C<[u], "sup G 'C>[u], liminft^+oo G ^[y], and 
lim supt^_l_o<3 y{t) S ^[y], and the second statement is proved in a similar fashion. 

■ 

Remark 5.9 It is an immediate consequence of Proposition[^]that, if a mono- 
tone system admits a static I/O characteristic k, and if there is a class-A^^oo 
function 7 such that \k(u) — k{v)\ < j{\u — v\) for all u,v (for instance, if k is 
Lipschitz with constant p one may pick as 7 the linear function "f{r) — pr) then 
the system has a Cauchy gain (in the sense of |^) 7 on bounded inputs. □ 

6 Feedback Interconnections 

In this section, we study the stability of SISO monotone dynamical systems 
connected in feedback as in Fig. 13 Observe that such interconnections need 
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Figure 2: Systems in feedback 

not be monotone. Based on Proposition l5.8l one of our main results will be the 
formulation of a small-gain theorem for the feedback interconnection of a system 
with monotonically increasing I/O static gain (positive path) and a system with 
monotonically decreasing I/O gain (negative path). 
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Theorem 3 Consider the following interconnection of two SISO dynamical sys- 
tems 

X = f^{x,w), y = h^{x) 
z = fz{z,y), w^h^{z) 

with Ux = yz o,nd lA^ = Suppose that: 

1. the first system is monotone when its input w as well as output y are 
ordered according to the "standard order" induced by the positive real semi- 
axis; 

2. the second system is monotone when its input y is ordered according to 
the standard order induced by the positive real semi-axis and its output w 
is ordered by the opposite order, viz. the one induced by the negative real 
semi-axis; 

3. the respective static I/S characteristics kx{-) and kz{-) exist (thus, the 
static I/O characteristics ky{-) and fc„,(-) exist too and are respectively 
monotonically increasing and monotonically decreasing) ; and 

4-. every solution of the closed-loop system is bounded. 

Then, system ^19\) has a globally attractive equilibrium provided that the follow- 
ing scalar discrete time dynamical system, evolving inUx'. 

Uk+i = {k^ o ky) (uk) (20) 

has a unique globally attractive equilibrium u. 

For a graphical interpretation of condition 1^0)1 see Fig. |31 




Figure 3: I/O characteristics in {w,y) plane: negative feedback 

Proof: Equilibria of H19|) are in one to one correspondence with solutions 
of kw{ky{u)) = u, viz. equilibria of (|20|l . Thus, existence and uniqueness of the 
equilibrium follows from the GAS assumption on H20|) . 
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Wc need to show that such an equiUbrium is globally attractive. Let ^ G 
R"=|= X M"^ be an arbitrary initial condition and let j/+ :— limsup^^^^ y{t,^) 
and y_ lim inf 4^+00 0- Then, w+ := limsupj^^g^ ^) and W- := 
liminff^+oo w{t, ^) satisfy by virtue of the second part of Proposition 15. 81 ap- 
plied to the z-subsystem: 

kw{y+) < w- < w+ < k^{y-). (21) 

An analogous argument, applied to the cc-subsystem, yields: ky{w^) < y- < 
y+ ^ ky{w-^-) and by combining this with the inequalities for and ti;_we end 
up with: 

ky{K{y+)) <y- <y+ < ky{k^{y_)) . 

By induction we have, after an even number 2n of iterations of the above argu- 
ment: 

{ky o fc^)2"(y_) < y_ < y+ < {ky o fc^)2"(y+) . 

By letting n — > -l-oo and exploiting global attractivity of H2UI) we have y_ ~ y+- 
Equation 121|l yields — w+. Thus there exists u, such that: 

u = limt^+oo?/(t,^) 
k^{u) = limt^+00 w(i, • 

Let Zf. be the (globally asymptotically stable) equilibrium (for the z-subsystem) 
corresponding to the constant input y{t) = u and Xe the equilibrium for the 
x-subsystem relative to the input 'w{t) = kw{u). Clearly rj := [xe,Ze] is the 
unique equilibrium of l|19(l . The fact that [x{t,^),z{t,(^)] rj now follows from 
Proposition 15. 51 ■ 

Remark 6.1 We remark that traditional small-gain theorems also provide suf- 
ficient conditions for global existence and boundedness of solutions. In this 
respect it is of interest to notice that, for monotone systems, boundedness of 
trajectories follows at once provided that at least one of the interconnected sys- 
tems has a uniformly bounded output map (this is always the case for instance 
if the state space of the corresponding system is compact). However, when both 
output maps are unbounded, boundedness of trajectories needs to be proved 
with different techniques. The following Proposition addresses this issue and 
provides additional conditions which together with the small-gain condition al- 
low to conclude boundedness of trajectories. □ 

We say that the I/S characteristic kx{-) is unbounded (relative to X) if for 
all ^ G X there exist ui,U2 ^ U so that kx{ui) h ^ h kx{u2)- 

Lemma 6.2 Suppose that the system is endowed with an unbounded I/S 
static characteristic and that inputs are scalar {Mu = R with the usual order). 
Then, for any ^ X there exists ^ G X so that for any input u: 

(P{t,tu) ^ maxU,fc. (sup,g[o,4]u(T))} Vi > 0. (23) 

An analogous property holds with ^ replaced by >: and sup's replaced by inf 's. 
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Proof: Let ^ X he arbitrary. As is unbounded there exists u such that 
C ^ kx{u) '■= ^. Pick any input u and any > 0, and let fi := sup^gjQ u(t). 
There are two possibihties: /i < u or > u. By monotonicity with respect to 
initial conditions and inputs, the first case yields: 

Hto,Lu)^(l>{to,^,u)^^. (24) 

So we assume from now on that fi > u. We introduce the input U defined as 
follows: U{t) := /i for all t < to, and U{t) ~ u{t) for t > to. Notice that U ^ u, 
and also that (j){to, kx{fJ-),U) — kx{p-), because the state kx{fJ-) is by definition 
an equilibrium of i = f{x.^) and U{t) = fi on the interval [0, to]. We conclude 
that 

0(io, u) ^ ^{to, kx{u), U)) = kxin) (25) 

and (|23|l follows combining (|24|l and (|25|) . The statement for >z is proved in the 
same manner. ■ 



Proposition 6.3 Consider the feedback interconnection of two SISO monotone 
dynamical systems as in ()19ll . and assume that the orders in both state-spaces 
are bounded. Assume that the systems are endowed with unbounded I/S static 
characteristics kx{-) and fcz(') respectively. If the small gain condition of Theo- 
rem |21 is satisfied then solutions exist for all positive times, and are bounded. 

Clearly, the above result allows to apply Theorem O also to classes of mono- 
tone systems for which boundedness of trajectories is not a priori known. 

Proof: We show first that solutions are upper-bounded. A symmetric ar- 
gument can be used for determining a lower bound. Let ^, be arbitrary initial 
conditions for the x and z subsystems. Correspondingly solutions are maximally 
defined over some interval [0,r). Let t be arbitrary in [0,T). By Lemma [6.21 
equation holds, for each of the systems. Moreover, composing (and 
its counter-part for lower-bounds) with the output map yields, for suitable con- 



stants y, w, y,w_ which only depend upon ^, 

y{t,£„w) < max{y,fcj^(max^g[o^f]w(T))} (26) 

w{t,C,y) < max{u;,A;„(min^g[o,f]y(T))} (27) 

y{t,£„w) > mm{y,ky{mmre[o,t]w{T))} (28) 

w{t,C,y) > min{u;, fc^(max^g[o,f]y(T))}. (29) 

Substituting equation H27|l into H2t)|) gives: 

y{t,£„w) < max{y,ky{w),ky o fc^(min^g[o,t]?/(T))} (30) 



and substitution of (|28|l into (|30() yields (using that ky o k^i is a nonincreasing 
function) : 

yit,^,w) < max^^y,ky{w),ky o k^{y), 

kyoknio fcj^(min,-g[o,t] w(t)) ^. 
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Finally equation into (|^ yields: 



y{t, S., w) < max |a, p o p max ^(t) j | , (32) 

where we are denoting p :— ky o and 

a := max{?7, ky{w), ky o k^^y), ky o k^ o ky{w)} . 

Let Tje be the output value of the x-subsystem, corresponding to the unique 
equilibrium of the feedback interconnection (|19|l . 

Notice that attractivity of (|20|l implies attractivity of y{t+l) = kyok^{y{t)) := 
p(jj(t)) and a fortriori of 

yit + l) = pop{y{t)). (33) 

We claim that y > ye =^ P° p{v) < V- By attractivity, there exists some yi > ye 
such that p o p{yi) — yi < (otherwise all trajectories of starting from 
y > ye would be monotonically increasing, which is absurd). Now, assume by 
contradiction that there exists also some y2 > ye such that p o p{y2) — 2/2 > 0. 
Then, as p is a continuous function, there would exist an yo € (1/1,2/2) (or in 
(2/2,2/1) if 2/2 < 2/1) such that po p{yo) = yo. This clearly violates attractivity 
(at 2/e) of H33|l . since 2/0 is an equilibrium point. So the claim is proved. 

Let M :— max^g^g 2/(t), so M — y{To) for some tq G [0,t]. Therefore 
at i = To says that yirg) < max{a,po p^y^To))}, and the previous claim ap- 
plied at 2/ = 2/('''o) gives that y{TQ) < max{a, 2/e} (by considering separately 
the cases yiro) > ye and y{TQ) < ye). As y{t) < yijo), we conclude that 
y(t) < max{a,2/e}- This shows that y is upper bounded by a function which 
depends only on the initial states of the closed-loop system. Analogous argu- 
ments can be used in order to show that y is lower bounded, and by symmetry 
the same applies to w. Thus, over the interval [0, T) the x and z subsystems are 
fed by bounded inputs and by monotonicity (together with the existence of I/S 
static characteristics) this implies, by Proposition 15.41 that T = +00 and that 
trajectories are uniformly bounded. ■ 



7 An Application 

A large variety of eukaryotic cell signal transduction processes employ "Mitogen- 
activated protein kinase (MAPK) cascades," which play a role in some of the 
most fundamental processes of life (cell proliferation and growth, responses to 
hormones, etc). A MAPK cascade is a cascade connection of three SISO systems, 
each of which is (after restricting to stoichiometrically conserved subsets) either 
a one- or a two-dimensional system, see We will show here that the 

two-dimensional case gives rise to monotone systems which admit static I/O 
characteristics. (The same holds for the much easier one-dimensional case, as 
follows from the results in '28'.) 
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After nondimensionalization, the basic system to be studied is a system as 
in (|12|l , where the functions 6i are of the type 9i (r) = i for various positive 
constants and bi. It foUows from Proposition 13.41 that our systems (with 
output y) are monotone, and therefore every MAPK cascade is monotone. 

We claim, further, that each such system has a static I/O characteristic. 
(The proof that we give is based on a resuh that is specific to two-dimensional 
systems; an alternative argument, based upon a triangular change of variables 
as mentioned earlier, would also apply to more arbitrary signaling cascades, 
see It will follow, by basic properties of cascades of stable systems, that 
the cascades have the same property. Thus, the complete theory developed in 
this paper, including small gain theorems, can be applied to MAPK cascades. 

Proposition 7.1 For any system of the type H12() . and each constant input u, 
there exists a unique globally asymptotically stable equilibrium inside A. 

Proof: As the set A is positively invariant, the Brower Fixed-Point Theorem 
ensures existence of an equilibrium. We next consider the Jacobian D/ of /. It 
turns out that for all (x^, x^) G A and all u > 

tr(D/) = -uDOiix^) ~ De2{l - - x'^) + 
- DOiix'^) - uDOsil - - x^) < 0, 
det(D/) = u^Dei{x^)De3{l-x^ -x^) + 

+ uDei{x^)Dei{x^) + 

+ De2{l~x^ -x^)Dei{x^)>Q. 

The functions 9i are only defined on intervals of the form (—1/6^, -l-oo). However, 
we may assume without loss of generality that they are each defined on all of 
M, and moreover that their derivatives are positive on all of M. Indeed, let us 
pick any continuously differentiable functions : M ^ M, i = 1, 2, 3, 4 with the 
properties that cr[{p) > for all p £ M, ai{p) — p for all p > 0, and the image 
of (Ti is contained in (—1/6^, +cx3). Then we replace each 9i by the composition 
02 o ai. 

Note that the functions 9i o Ui have an everywhere positive derivative, so 
tr(D/) and det(D/) are everywhere negative and positive, respectively, in R^. 
So D/ is Hurwitz everywhere. The Markus-Yamabe conjecture on global asymp- 
totic stability (1960) was that if a map R" R" has a zero at a point p, and 
its Jacobian is everywhere a Hurwitz matrix, then p is a globally asymptotically 
stable point for the system x = f{x). This conjecture is known to be false in 
general, but true in dimension two, in which case it was proved simultaneously 
by Fessler, Gutierres, and Glutsyuk in 1993, see e.g. [TT]. Thus, our (modified) 
system has its equilibrium as a globally asymptotically stable attractor in R^. 
As inside the triangle A, the original ^^'s coincide with the modified ones, this 
proves global stability of the original system (and, necessarily, uniqueness of the 
equilibrium as well). ■ 

As an example, Fig.^lshows the phase plane of the system (the diagonal line 
indicates the boundary of the triangular region of interest), when coefficients 
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have been chosen so that the equations are: xi 
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X2 



_ l — Xi'~X2 



1+xi 



1—XI—X2 

3 — Xi —X2 



and 



2+X2 ■ 
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Figure 4: Direction field for example 



As a concrete illustration, let us consider the open-loop system with these 
equations: 

vi (100 - Xl) _ gxxx 92 + u 
k2 + (100 — Xl) ki+ Xl 54 + u 

ve (300 - yi - ys) ^ K3 (100 - xi)yi 
ke + (300 -yi~ ys) k^ + yi 

K4 (100 - (300 - yi - ys) _ ^^5 ^3 
fc4 + (300 - yi - ya) k^ + ys 

t;io (300 - zi- Z3) _ K7 zi 
kio + (300 — zi — Z3) ^7 + zi 

Kg ^3 (300 -Zi -Z3) _ Vg Z3 

/cs + (300 - zi - Z3) kg + Z3 

This is the model studied in (IBj, from which we also borrow the values of 
constants (with a couple of exceptions, see below): gi = 0.22, 52 = 45, 94 = 50, 
fci = 10, V2 = 0.25, fc2 = 8, K3 = 0.025, ks = 15, K4 = 0.025 ki = 15, V5 = 0.75, 
fcs = 15, Ve = 0.75, fcg = 15, K7 = 0.025, kr = 15, Kg = 0.025, ks = 15, = 0.5, 
fcg = 15, vio = 0.5, fcio = 15. Units are as follows: concentrations and Michaehs 
constants (k's) are expressed in nM, catalytic rate constants (k's) in s~^, and 
maximal enzyme rates (v's) in nM.s~^. The paper jJS] showed that oscillations 
may arise in this system for appropriate values of negative feedback gains. (We 
have slightly changed the input term, using coefficients gi, 92, <74, because we 
wish to emphasize the open-loop system before considering the effect of negative 
feedback.) 

Since the system is a cascade of elementary MAPK subsystems, we know 
that our small-gain result may be applied. Figure[3shows the I/O characteristic 
of this system, as well as the characteristic corresponding to a feedback u = ; 
with the gain K = 30000. It is evident from this planar plot that the small-gain 
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Figure 5: I/O characteristic and small-gain for MAPK example 



condition is satisfied - a "spiderweb" diagram shows convergence. Our theorem 
then guarantees global attraction to a unique equilibrium. Indeed, Figure El 
shows a typical state trajectory. 

8 Relations to Positivity 

In this section we investigate the relationship between the notions of cooperative 
and positive systems. Positive linear systems (in continuous as well as discrete 
time) have attracted much attention in the control literature, see for instance 
13 Uni m EH 122 EOI- we wlU say that a finite dimensional linear system, 
possibly time- varying, 

i = A{t)x + B{t)u (34) 

(where the entries of the n x n matrix A and the n x m matrix B are Lebesgue 
measurable locally essentially bounded functions of time) is positive if the pos- 
itive orthant is forward invariant for positive input signals; in other words, for 
any ^ ^ and any u{t) ^ (^ denotes here the partial orders induced by the 
positive orthants), and any tg € M it holds that 4>{t,to,£^,u) >: for all t > to- 
Let say that H34|l is a Metzler system if A{t) is a Metzler matrix, i.e., Aij (t) > 
for all i j, and Bij{t) > for all j, j, for almost alH > 0. It is well known 
for time-invariant systems {A and B constant), see for instance jj^jj Chapter 
6, or Uj for a recent reference, that a system is positive if and only if it is a 
Metzler system. This also holds for the general case, and we provide the proof 
here for completeness. For simplicity in the proof, and because we only need 
this case, wc make a continuity assumption in one of the implications. 

Lemma 8.1 If H34() is a Metzler system then it is positive. Conversely, if l|34|l 
is positive and A{-) and B{-) are continuous, then H34|) is a Metzler system. 
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Figure 6: Simulation of MAPK system under negative feedback satisfying small- 
gain conditions. Key: xi dots, yi dashes, 1/2 dash-dot, Zi circles, Z3 solid 



Proof: Let us prove sufficiency first. Consider first any trajectory x{-) with 
x{s) » 0, any fixed T > s, and any input it(-) so that u{t) > for all t > s. 
We need to prove that x{T) >z 0. Since A{t) is essentially bounded (over any 
bounded time-interval) and Metzler, there is an r > such that rl + A{t) > 
for almost all t G [s,T], where ">" is meant elementwise. Consider z{t) := 
exp(r(t — s))x{t) and v{t) := exp{r{t — s))u(t), and note that z{s) = x{s) 
and v{t) > for all t > s. We claim that z{t) t for all t € [s,T]. Let 
T > s be the infimum of the set of t's such that z{t) ^ and assume, by 
contradiction, r < +00. By continuity of trajectories, z{t) >z 0. Moreover 
z{t) = z{s) + jl z{t)dt = z{s) + /J(r/ + A{t))z{t) + B{t)v{t)dt h z{s) > 0, 
and therefore there exists an interval [r, r + e] such that z{t) >: for all t G 
[r, T + e]. But this is a contradiction, unless r = -hoc as claimed. By continuous 
dependence with respect to initial conditions, and closedness of the positive 
orthant, the result carries over to any initial condition x{s) >: 0. For the converse 
implication, denote with <I>(t, s) the fundamental solution associated to A{t) 
{d^/dt = A{t)^, $(s, s) = I). Using u = we know that s) > whenever 
t > s (">" is meant here elementwise). Therefore also s) — I]ij > for 
all i ^ j. Since A{t) = (d/dt)\^^^ $(t,T) = limt^o ^^^^ for all t, it follows 
that A{T)ij > for all i ^ j. Consider a solution with x{s) — 0, u constant 
> 0, for t > s. Since x{t) ^ 0, also {l/{t — s))x{t) >z 0, and therefore, taking 
limits as t \ 0, x{s) ^ (the derivative exists by the continuity assumption). 
But x{s) = A{s)x{s) + B{s)u, and x{s) = 0, so B{s)u >: for all such u, i.e. 
B{s) hO- ■ 
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Thus, by virtue of Theorem l3.2l a time-invariant linear system is cooperative 
if and only if it is positive. The next result is a system-theoretic analog of the 
fact that a differentiable scalar real function is monotonically increasing if and 
only if its derivative is always nonnegative. 

We say that a system is incrementally positive (or "variationally posi- 
tive") if, for every solution x{t) = (f){t,^,u) of (0), the linearized system 



where A{t) = ^{x{t),u{t)) and B{t) = ^{x{t),u{t)), is a positive system. 

Proposition 8.2 Suppose that B;^ = R™, U satisfies an approximability prop- 
erty, and that both V and W = intW are order-convex. Let f{x,u) be con- 
tinuously differentiable. Then system is cooperative if and only if it is 
incrementally positive. 

Proof: Under the given hypotheses, a system is cooperative iff ^(x, w) is 
a Metzler matrix, and every entry of ^{x,u) is nonnegative, for all x € X and 
all u €U, cf. Proposition 13. 21 Therefore, by the criterion for positivity of linear 
time-varying systems, this implies that (|35(l is a positive linear time-varying 
system along any trajectory of Q|. 

Conversely, pick an arbitrary ^ in X and any input of the form u(-) = u ^ U. 
Suppose that (|35|l is a positive linear time-varying system along the trajectory 
x{t) = x{t,S,,u) (this system has continuous matrices A and B because u is 
constant). Then, by the positivity criterion of linear time- varying systems, for 
alH > we have ^{x{t), u) is Metzler and |£(x(t), u) ^ 0. Finally, evaluating 
the Jacobian at t = yields that f|(C, u) is Metzler and u) is nonnegative. 
Since ^ and u were arbitrary, we have the condition for cooperativity given in 
Proposition 13. 21 ■ 

Remark 8.3 Looking at cooperativity as a notion of "incremental positivity" 
one can provide an alternative proof of the infinitesimal condition for coopera- 
tivity, based on the positivity of the variational equation. Indeed, assume that 
each system (|35|l is a positive linear time-varying system, along trajectories of 
Q. Pick arbitrary initial conditions '(Z (.2 ^ X and inputs ui > U2- Let 
$(/i) := </'(i, 1^2 + ^(^1 — ^2),U2 + h{ui — U2))- We have (see e.g. Theorem 1 in 



EZl) that0(i,a,ui)-0(i,6,W2) = $(l)-$(O)= /o$'(/i)d/i = /oZ^(t,6- 



^2, ui dh, where Zh denotes the solution of H35|l when -^{x, u) and -^{x, u) 
are evaluated along (pit, ^2 + ^(^1 — ^2)1 ""2 + h{ui — U2)). Therefore, by positiv- 
ity, and monotonicity of the integral, we have 0(f, ^i,Ui) — 4>{t, £,2t'^2) ^ Oi as 



We remark that monotonicity with respect to other orthants corresponds to 
generalized positivity properties for linearizations, as should be clear by Corol- 
lary 



A{t)z + B{t)v 



(35) 



claimed. 



□ 
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Appendix: A Lemma on Invariance 



We present here a characterization of invariance of relatively closed sets, under 
differential inclusions. T he result is a simple adaptation of a well-known con- 
dition, and is expressed in terms of appropriate tangent cones. We let V be an 
open subset of some Euclidean space and consider set-valued mappings F 
defined on V: these are mappings which assign some subset F{x) C R" to each 
X G V. Associated to such mappings F are differential inclusions 

X G F{x) (36) 

and one says that a function x : [0, T] ^ V is a solution of H36|l if x is an 
absolutely continuous function with the property that x{t) £ F(x{t)) for almost 
all i G [0,T]. A set- valued mapping F is compact-valued if F(^) is a compact 
set, for each ^ £ V, and it is locally Lipschitz if the following property holds: 
for each compact subset C C V there is some constant k such that F{^) C 
F{C) + k\C-C\B for aU ^, C G C, where B denotes the unit ball in K". (We use 
\x\ to denote Euclidean norm in M".) Note that when F{x) = {f{x)} is single- 
valued, this is the usual definition of a locally Lipschitz function. More generally, 
suppose that f{x,u) is locally Lipschitz in x G V, locally uniformly on u, and 
pick any compact subset D of the input set U; then F]j{x) — {/(x,m),u G D} 
is locally Lipschitz and compact- valued. We say that the set- valued mapping F 
defined on V is locally bounded if for each compact subset C C V there is some 
constant k such that F(^) C kB for all ^ G C. When F has the form Fjj as 
above, it is locally bounded, since Fjj{^) C /(C x D), and, / being continuous, 
the latter set is compact. 

Let iS be a (nonempty) closed subset relative to V, that is, S = Sf^V for 
some closed subset S of M" . We wish to characterize the property that solutions 
which start in the set S must remain there. Recall that the subset S is said to be 
strongly invariant under the differential inclusion H36(l if the following property 
holds: for every solution x : [0,T] ^ V which has the property that x(0) G <S, 
it must be the case that x{t) G S for all t G [0, T]. 

Note that a vector v belongs to T^S (the "Bouligand" or "contingent" tan- 
gent cone) if and only if there is a sequence of elements Vi G V, Wi — > w and a 
sequence ti \ such that £, + tiVi G 5 for all i. Further, T^S — M" when x is 
in the interior of S relative to V (so only boundary points are of interest). 

Theorem 4 Suppose that F is a locally Lipschitz, compact-valued, and locally 
bounded set-valued mapping on the open subset V C R", and S is a closed subset 
ofV. Then, the following two properties are equivalent: 

1. S is strongly invariant under F. 

2. F{^) C T^S for every ^ G 5. 

Just for purposes of the proof, let us say that a set-valued mapping F is 
"nice" if F is defined on all of K" and it satisfies the following properties: 
F is locally Lipschitz, compact-valued, convex- valued, and globally bounded 
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(F(^) C kB for all ^ G M", for some k). Theorem 4.3.8 in establishes that 
Properties 1 and 2 in the statement of Theorem 0] are equivalent, and are also 
equivalent to: 

F{£,)(ZcoT^S foreveryCe^ (37) 

("co" indicates closed convex hull) provided that 5 is a closed subset of M" 
and F is nice (a weaker linear growth condition can be replaced for global 
boundedness, c.f. the "standing hypotheses" in Section 4.1.2 of ^). We will 
reduce to this case using the following observation. 

Lemma A. 4 Suppose that F is a locally Lipschitz, compact-valued, and locally 
bounded set-valued mapping on the open subset V C M", and 5 is a closed 
subset of V. Let M be any given compact subset of V. Then, there exist a nice 
set-valued F and a closed subset S' of M" such that the following properties 
hold: 

F{0 C F{i) Ve e Af (38) 
M^S Q S' Q S (39) 

G 5', either F{0 ^ {0} or r^S = T^S' (40) 
T^S^T^S' VeeM. (41) 
and S strongly invariant under F implies S' strongly invariant under F. 

Proof: Consider the convexification F of F; this is the set-valued function 
on V which is obtained by taking the convex hull of the sets F{£^), i.e. F{^) := 
coF{^) for each ^ G V. It is an easy exercise to verify that if F is compact- 
valued, locally Lipschitz, and locally bounded, then F also has these properties. 

Clearly, if S is strongly invariant under F then it is also strongly invariant 
under F, because every solution of i G F{x) must also be a solution of i G F(x). 
Conversely, suppose that S is strongly invariant under F, and consider any 
solution x : [0, r] ^ V of i; G F{x) which has the property that x(0) G S. 
The Filippov-Wazewski Relaxation Theorem provides a sequence of solutions 
Xk, k — 1,2,..., of i G F{x) on the interval [0,T], with the property that 
Xk{t) x{t) uniformly on i G [0,r] and also Xfc(O) = a;(0) G S for all k. Since 
S is strongly invariant under F, it follows that Xk{t) G S for all k and t G [0, T], 
and taking the limit as fc — > oo this implies that also x{t) G S for all t. In 
summary, invariance under F ov F are equivalent, for closed sets. 

Let iV be a compact subset of V which contains M in its interior int N and 
pick any smooth function : R" R>o with support equal to N (that is, 
(y9(^) = if a; ^ int and if{£) > on int N) and such that (f{S) = 1 on the 
set M . Now consider the new differential inclusion defined on all of M" given 
by F{£) := ip{£)F{£) if ^ G and equal to {0} outside N. Since F is locally 
Lipschitz and locally bounded, it follows by a standard argument that F has 
these same properties. Moreover, F is globally bounded and it is also convex- 
valued and compact- valued (see e.g. ^Hl)- Thus F is nice, as required. Note 
that Property holds, because F{£) C F{£) and ip = l on M . 
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Let S' :— Sf]N (cf. Figure [Tj); this is a closed subset of R" because the 
compact set N has a strictly positive distance to the complement of V. Prop- 
erty ()39|l holds as well, because M C N. Now pick any ^ e 5'. There are two 
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M 



Figure 7: Shaded area is set S' 



cases to consider: ^ is in the boundary of TV or in the interior of N. If ^ S dN, 
then F(^) = {0} because ip{^) — 0. If instead ^ belongs to the interior of N, 
there is some open subset V C N such that ^ G V. Therefore any sequence 
— > ^ with all G S has, without loss of generality, GVf^SCNf^S = S', 
so also ^ C in S'; this proves that 7^5 C 7^5', and the reverse inclusion 
is true because S' C S. Hence Property H4l)|l has been established. Regarding 
Property H41|l . this follows from the discussion in the previous paragraph, since 
M is included in the interior of N. 

In order to prove the last property in the theorem, we start by remarking that 
if X : [0, T] M" is a solution of i e F{x) with the property that x{t) belongs 
to the interior of N for all t (equivalently, (p{x{t)) ^ for all t), then there is a 
reparanietrization of time such that a; is a solution of i G F{x). In precise terms: 
there is an interval [0, i?], an absolutely continuous function a : [0, oo) [0, oo) 
such that a(0) = and a(i?) = T, and a solution z : [0, i?] ^ R" of i e F{z) 
such that z{r) — x{a{r)) for all r G [0, R]. To see this, it is enough (chain rule, 
remembering that F{^) = (p{£^)F{x)) for a to solve the initial value problem 
da/dr = /3(a(r)), a(0) = 0, where = l/^ix{t)) for t < T and P{t) = P(T) 
for t > T. The function ip{x{t)) is absolutely continuous, and is bounded away 
from zero for alH < T (because the solution x lies in a compact subset of the 
interior of the support of (p), so /3 is locally Lipschitz and a (unique) solution 
exists. Since (3 is globally bounded, the solution has no finite escape times. In 
addition, since the vector field is everywhere positive, a{r) — * oo as s oo, so 
there is some R such that a{R) = T. 

Now suppose that S is invariant under F. As remarked, then S is invariant 
under its convexification F. Suppose that x : [0, T] — > M" is a solution of 
X = F{x) such that x{0) e S' and x{t) is in the interior of N for all t. We 
find a solution z of i G F{z) such that z{r) = x{a{r)) for all r G [0,R] and 
z(0) = a;(0) G 5' C 5 as earlier. Invariance of S under F gives that z{r), and 
hence x{t), remains in S. Since S' = Sf]N, we conclude that x{t) G S' for all 
tG [0,T]. 

Next, we use some ideas from the proof of Theorem 4.3.8 in Pick any 
^0 £ >5', and any v G F{^o). Define the mapping / : M" ^ R" by the following 
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rule: for each ^ G R", /(^) is the unique closest point to v in F(^). As in the 
above citation, this map is continuous. We claim that, for each ^ e 5' there is 
some S > and a solution of i = f{x) such that x(0) = ^ and x{t) G 5' for 
all t G [0,(5]. (Note that, in particular, this x solves x G F{x).) If ^ is on the 
boundary of TV, then F{^) — {0} implies that /(^) = 0, and hence x{t) = ^ 
is such a solution. If instead ^ belongs to the interior of N then the previous 
remarks shows that x{t) G S' for all t G [0,(5], where we pick a smaller (5 if 
needed in order to insure that x{t) remains in the interior of N. We conclude 
from the claim that the closed set S' is locally-in-time invariant with respect 
to the differential inclusion {f{x)}, which satisfies the "standing hypotheses" 
in Chapter 4 of 0]. This inclusion is hence also "weakly invariant" as follows 
from Exercise 4.2.1 in that textbook. This in turn implies, by Theorem 4.2.10 
there, that {/{£,),() ^ for C G '5' and all in the proximal normal set 
N^S' defined in that reference (we are using a different notation). Applied in 
particular at the point (so that /(^o) = v), we conclude that {v, for all 

C G ^io^' ■ Since v was an arbitrary element of F{£^q), it follows that the upper 
Hamiltonian condition in part (d) of Theorem 4.3.8 in ^ holds for the map F 
at the point ^o- Since was itself an arbitrary point in 5', the condition holds 
on all of 5'. Therefore S' is invariant for F, as claimed. ■ 
Proof of Theorem |3| 

We first prove that 2=>1. Suppose that F{£_) C T^S for every S, E S, and 
pick any solution x : [0, T] ^ V of i G F{x) with x(0) G S. 

Since x{-) is continuous, there is some compact subset M C V such that 
x{t) G M for aU t G [0,T]. We apply Lemma FOl to obtain F and S' . By 
Property (|38() . it holds that x is also a solution of i G F{x), and Property H39|l 
gives that x(0) belongs to the subset S' . Taking convex hulls, F{x) C co7^5 
for every x E S. Since F is a scalar multiple of F, and coT^S is a cone (because 
7j<S is a cone), it follows that F{£^) C co7^5 for every ^ G 5, and so also for 
C G S'. By Property EOJ), F{^) C coT^^' G S' , since either F(^) = or 

T^S' = T^S (and hence their convex hulls coincide). 

In summary. Property H37|l is valid for F in place of F and <S' in place of 
S, and F is nice. Thus we may apply Theorem 4.3.8 in 0] to conclude that S' 
is strongly invariant under F. Since a;(0) G S', it follows that x{t) G S' for all 
t G [0, T], and therefore also x{t) G 5 for all t G [0, T], as wanted. 

We now prove that 1=>2. Suppose that S is strongly invariant under F, and 
pick any G S. We apply Lemma [A. 41 with M = {£,0}, to obtain F and S' . 
Note that Mf]S = {^0}, so ^0 £ 5'. Moreover, 5' is strongly invariant under 
F. Since S' is closed and F is nice, Theorem 4.3.8 in 1 gives that F{£) C T^S' 
for all ^ G iS', and in particular for ^ = ^o- By Property (j40|l . either -F'(fo) = {0} 
or 7^5' = 7^5, so we have that F(^) C T^.? for ^ = ^o- Moreover, Property 
gives that F(^) C F(£) for ^ = ^q. Since ^0 was an arbitrary element of S, the 
proof is complete. I 
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